2026-10-31 00:08:25,355 [ 243851 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy (runner:42, check_args_and_update_paths) 2026-10-31 00:08:25,355 [ 243851 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:90, check_args_and_update_paths) 2026-10-31 00:08:25,355 [ 243851 ] INFO : src dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/src (runner:97, check_args_and_update_paths) 2026-10-31 00:08:25,355 [ 243851 ] INFO : base_configs_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:99, check_args_and_update_paths) 2026-10-31 00:08:25,355 [ 243851 ] INFO : Unknown image altinityinfra/dotnet-client (runner:359, ) Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_zd7pz2 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=2741 -e DOCKER_BASE_TAG=2741 -e DOCKER_KERBERIZED_HADOOP_TAG=2741 -e DOCKER_KERBEROS_KDC_TAG=2741 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=2741 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=2741 -e DOCKER_MYSQL_JS_CLIENT_TAG=2741 -e DOCKER_MYSQL_PHP_CLIENT_TAG=2741 -e DOCKER_NGINX_DAV_TAG=2741 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=2741 -e DOCKER_PYTHON_BOTTLE_TAG=2741 -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 test_system_start_stop_listen/test.py::test_except -vvv" altinityinfra/integration-tests-runner:2741 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.7.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 5/5 workers 5 workers [1 item] scheduling tests via LoadFileScheduling test_system_start_stop_listen/test.py::test_except [gw0] [100%] PASSED test_system_start_stop_listen/test.py::test_except [gw0] [100%] ERROR test_system_start_stop_listen/test.py::test_except ==================================== ERRORS ==================================== _______________________ ERROR at teardown of test_except _______________________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.start() yield cluster finally: > cluster.shutdown() test_system_start_stop_listen/test.py:36: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , kill = True ignore_fatal = True def shutdown(self, kill=True, ignore_fatal=True): sanitizer_assert_instance = None fatal_log = None if self.up_called: with open(self.docker_logs_path, "w+") as f: try: subprocess.check_call( # STYLE_CHECK_ALLOW_SUBPROCESS_CHECK_CALL self.base_cmd + ["logs"], stdout=f ) except Exception as e: logging.debug("Unable to get logs from docker.") f.seek(0) for line in f: if SANITIZER_SIGN in line: sanitizer_assert_instance = line.split("|")[0].strip() break if kill: try: run_and_check(self.base_cmd + ["stop", "--timeout", "20"]) except Exception as e: logging.debug( "Kill command failed during shutdown. {}".format(repr(e)) ) logging.debug("Trying to kill forcefully") run_and_check(self.base_cmd + ["kill"]) # Check server logs for Fatal messages and sanitizer failures. # NOTE: we cannot do this via docker since in case of Fatal message container may already die. for name, instance in self.instances.items(): if instance.contains_in_log( SANITIZER_SIGN, from_host=True, filename="stderr.log" ): sanitizer_assert_instance = instance.grep_in_log( SANITIZER_SIGN, from_host=True, filename="stderr.log", after=1000, ) logging.error( "Sanitizer in instance %s log %s", name, sanitizer_assert_instance, ) if not ignore_fatal and instance.contains_in_log( "Fatal", from_host=True ): fatal_log = instance.grep_in_log("Fatal", from_host=True) if "Child process was terminated by signal 9 (KILL)" in fatal_log: fatal_log = None continue logging.error("Crash in instance %s fatal log %s", name, fatal_log) try: subprocess_check_call(self.base_cmd + ["down", "--volumes"]) except Exception as e: logging.debug( "Down + remove orphans failed during shutdown. {}".format(repr(e)) ) else: logging.warning( "docker-compose up was not called. Trying to export docker.log for running containers" ) self.cleanup() self.is_up = False self.docker_client = None for instance in list(self.instances.values()): instance.docker_client = None instance.ip_address = None instance.client = None if sanitizer_assert_instance is not None: > raise Exception( "Sanitizer assert found for instance {}".format( sanitizer_assert_instance ) ) E Exception: Sanitizer assert found for instance ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b540000eb68 by thread T2: E #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2547:16 (clickhouse+0xfadb977) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb977) E #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb977) E #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b540000eb68 by thread T256 (mutexes: write M0): E #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) E #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) E #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) E #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) E #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) E #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) E #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) E #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) E #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) E #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) E #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) E #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) E #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in __tsan_memcpy E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 1 at 0x7b540000ec1f by thread T2: E #0 std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 (clickhouse+0xfadb980) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2551:11 (clickhouse+0xfadb980) E #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb980) E #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb980) E #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b540000ec18 by thread T256 (mutexes: write M0): E #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) E #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) E #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) E #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) E #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) E #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) E #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) E #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) E #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) E #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) E #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) E #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) E #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 in std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 1 at 0x7b540000ec08 by thread T2: E #0 std::__1::char_traits::assign(char&, char const&) build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 (clickhouse+0xfadb98d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2552:5 (clickhouse+0xfadb98d) E #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb98d) E #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb98d) E #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b540000ec08 by thread T256 (mutexes: write M0): E #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) E #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) E #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) E #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) E #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) E #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) E #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) E #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) E #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) E #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) E #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) E #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) E #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 in std::__1::char_traits::assign(char&, char const&) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b540000ec38 by thread T2: E #0 std::__1::unique_ptr>::release[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 (clickhouse+0xfadba10) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:15 (clickhouse+0xfadba10) E #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba10) E #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b540000ec38 by thread T256 (mutexes: write M0): E #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) E #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) E #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) E #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) E #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) E #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) E #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) E #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) E #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) E #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) E #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) E #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) E #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) E #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 in std::__1::unique_ptr>::release[abi:v15000]() E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b540000eb98 by thread T2: E #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadba24) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba24) E #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba24) E #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b540000eb98 by thread T256 (mutexes: write M0): E #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) E #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) E #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) E #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) E #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) E #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) E #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) E #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) E #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) E #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) E #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) E #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) E #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) E #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b0400002cb8 by thread T2: E #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) E #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) E #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) E #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) E #6 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) E #7 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) E #8 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b0400002cb8 by thread T256 (mutexes: write M0): E #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) E #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 16 at 0x7b0400002cb0 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) E #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2125:24 (clickhouse+0xfaccc32) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaccc32) E #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaccc32) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaccc32) E #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaccc32) E #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2118:13 (clickhouse+0xfabc442) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b4000004718 by thread T2: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) E #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) E #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) E #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) E #13 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) E #14 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) E #15 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #17 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #18 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #20 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #21 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #22 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #23 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #25 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #26 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #31 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #32 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #33 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #34 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #35 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous atomic read of size 4 at 0x7b4000004718 by thread T256 (mutexes: write M0): E #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) E #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) E #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) E #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b4400027398 by thread T2: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) E #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) E #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) E #9 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) E #10 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) E #11 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b4400027398 by thread T256 (mutexes: write M0): E #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b0400002cb0 by thread T2: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) E #4 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) E #5 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) E #6 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) E #8 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) E #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #11 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #12 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #13 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #14 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #16 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #17 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b0400002cb0 by thread T256 (mutexes: write M0): E #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) E #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) E #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) E #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) E #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) E #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T2 'TCPHandler' (tid=9, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E LLVMSymbolizer: error reading file: No such file or directory E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Read of size 8 at 0x7ffd7fcb7440 by thread T256 (mutexes: write M0): E #0 std::__1::vector>::size[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 (clickhouse+0xfac7c01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:756:77 (clickhouse+0xfac7c01) E #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7c01) E #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7c01) E #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7c01) E #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7c01) E #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Previous write of size 8 at 0x7ffd7fcb7440 by thread T288: E #0 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:834:18 (clickhouse+0xfadb878) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb878) E #2 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb878) E #3 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac38b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2422:5 (clickhouse+0xfac38b9) E #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #7 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #8 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #9 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #10 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #12 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #13 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #19 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Location is stack of main thread. E E Location is global '??' at 0x7ffd7fc98000 ([stack]+0x1f440) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 in std::__1::vector>::size[abi:v15000]() const E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b540000ecd8 by thread T288: E #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadb76a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb76a) E #2 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb76a) E #3 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb76a) E #4 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb76a) E #5 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb76a) E #6 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb76a) E #7 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb76a) E #8 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb76a) E #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b540000ecd8 by thread T256 (mutexes: write M0): E #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) E #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) E #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) E #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) E #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) E #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) E #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) E #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) E #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) E #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) E #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) E #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) E #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) E #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b0400003498 by thread T288: E #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) E #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) E #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) E #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) E #6 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) E #7 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) E #8 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) E #9 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) E #10 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) E #11 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) E #12 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) E #13 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) E #14 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #16 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #18 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #19 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #20 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #21 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #23 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #24 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #31 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #32 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #33 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b0400003498 by thread T256 (mutexes: write M0): E #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) E #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Location is heap block of size 16 at 0x7b0400003490 allocated by thread T259: E #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) E #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2283:24 (clickhouse+0xfaced31) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaced31) E #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaced31) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaced31) E #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaced31) E #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) E #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) E #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2277:13 (clickhouse+0xfabd0b1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1558:9 (clickhouse+0xfacc83f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc83f) E #14 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc83f) E #15 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc83f) E #16 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc83f) E #17 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909748) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909748) E #19 DB::Context::startServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3832:5 (clickhouse+0x18909748) E #20 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:627:27 (clickhouse+0x1961c92f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #21 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::__1::shared_ptr, std::__1::function, std::__1::optional const&, std::__1::function) build_docker/./src/Interpreters/executeQuery.cpp:1322:34 (clickhouse+0x19a5bddd) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:483:9 (clickhouse+0x189aa43f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 DB::DDLWorker::processTask(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:646:17 (clickhouse+0x189a7e1d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 DB::DDLWorker::scheduleTasks(bool) build_docker/./src/Interpreters/DDLWorker.cpp:426:13 (clickhouse+0x189a5932) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 DB::DDLWorker::runMainThread() build_docker/./src/Interpreters/DDLWorker.cpp:1126:13 (clickhouse+0x1899f309) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 decltype(*std::declval().*std::declval()()) std::__1::__invoke[abi:v15000](void (DB::DDLWorker::*&)(), DB::DDLWorker*&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:359:23 (clickhouse+0x189b7dbf) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::__1::tuple&, std::__1::__tuple_indices<0ul>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0x189b7dbf) E #29 decltype(auto) std::__1::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::__1::tuple&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0x189b7dbf) E #30 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0x189b7dbf) E #31 decltype(std::declval()(std::declval())) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0x189b7d01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #32 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0x189b7d01) E #33 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0x189b7d01) E #34 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0x189b7d01) E #35 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #36 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #37 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #38 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #39 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #40 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #41 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T259 'DDLWorker' (tid=266, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x189b7b99) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 std::__1::__unique_if>::__unique_single std::__1::make_unique[abi:v15000], void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:32 (clickhouse+0x1899ea6f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::DDLWorker::startup() build_docker/./src/Interpreters/DDLWorker.cpp:126:19 (clickhouse+0x1899ea6f) E #8 DB::Context::setDDLWorker(std::__1::unique_ptr>) build_docker/./src/Interpreters/Context.cpp:2773:17 (clickhouse+0x188fc7b5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1877:29 (clickhouse+0xfab2fac) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #14 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b4000008318 by thread T288: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) E #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) E #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) E #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) E #13 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) E #14 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) E #15 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) E #16 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) E #17 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) E #18 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) E #19 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) E #20 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) E #21 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #23 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #25 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #26 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #27 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #28 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #30 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #31 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #32 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #33 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #34 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #35 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #36 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #37 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #38 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #39 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #40 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous atomic read of size 4 at 0x7b4000008318 by thread T256 (mutexes: write M0): E #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) E #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) E #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) E #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b4400070458 by thread T288: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) E #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) E #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) E #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) E #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) E #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) E #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) E #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) E #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) E #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) E #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) E #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b4400070458 by thread T256 (mutexes: write M0): E #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b0400003490 by thread T288: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) E #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) E #5 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) E #6 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) E #7 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) E #8 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) E #9 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) E #10 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) E #11 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) E #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b0400003490 by thread T256 (mutexes: write M0): E #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) E #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) E #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) E #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) E #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) E #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b4000008118 by thread T288: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af3c281) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:23:1 (clickhouse+0x1af3c281) E #6 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) E #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) E #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #11 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #12 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) E #14 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) E #15 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) E #16 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) E #17 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) E #18 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) E #19 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) E #20 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) E #21 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) E #22 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #23 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #24 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #26 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #27 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #28 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #29 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #31 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #32 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #33 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #34 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #35 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #36 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #37 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #38 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #39 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #40 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #41 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous atomic read of size 4 at 0x7b4000008118 by thread T256 (mutexes: write M0): E #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) E #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) E #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) E #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ================== E WARNING: ThreadSanitizer: data race (pid=1) E Write of size 8 at 0x7b4400100058 by thread T288: E #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) E #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) E #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) E #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) E #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) E #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) E #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) E #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) E #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) E #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) E #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) E #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) E #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) E #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) E #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) E #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) E #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) E #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) E #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) E #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Previous read of size 8 at 0x7b4400100058 by thread T256 (mutexes: write M0): E #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) E #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) E #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) E #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) E #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) E #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) E #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) E #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) E #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) E #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) E #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) E #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) E #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) E #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) E #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) E #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) E #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) E #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) E #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) E E Mutex M0 (0x7ffd7fcb7038) created at: E #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) E #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) E #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) E #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: E #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) E #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) E E SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) E ================== E ThreadSanitizer: reported 17 warnings helpers/cluster.py:3092: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ ------------------------------ Captured log setup ------------------------------ 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:105, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : No running containers (conftest.py:60, cleanup_environment) 2026-10-31 00:08:29 [ 353 ] DEBUG : Pruning Docker networks (conftest.py:62, cleanup_environment) 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:['docker network prune --force'] (cluster.py:105, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:105, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:113, run_and_check) 2026-10-31 00:08:29 [ 353 ] INFO : Running tests in /ClickHouse/tests/integration/test_system_start_stop_listen/test.py (cluster.py:2637, start) 2026-10-31 00:08:29 [ 353 ] DEBUG : Cluster start called. is_up=False (cluster.py:2644, start) 2026-10-31 00:08:29 [ 353 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 29.9.2 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.38.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v5.6.1 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 38 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 runc Default Runtime: runc Init Binary: docker-init containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51 runc version: v1.5.2-0-g29dd3dc2 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-130-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.59GiB Name: a6986a094fcd ID: 53fefab7-1d8c-495d-a06e-efd0556b52e1 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Docker networks for project roottestsystemstartstoplisten are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Docker containers for project roottestsystemstartstoplisten are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Docker volumes for project roottestsystemstartstoplisten are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Cleanup called (cluster.py:754, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 29.9.2 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.38.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v5.6.1 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 38 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51 runc version: v1.5.2-0-g29dd3dc2 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-130-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.59GiB Name: a6986a094fcd ID: 53fefab7-1d8c-495d-a06e-efd0556b52e1 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Docker networks for project roottestsystemstartstoplisten are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Docker containers for project roottestsystemstartstoplisten are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Docker volumes for project roottestsystemstartstoplisten are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:docker container list --all --filter name='^/roottestsystemstartstoplisten_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : No running containers for project: roottestsystemstartstoplisten (cluster.py:782, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Images pruned (cluster.py:807, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup) 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) 2026-10-31 00:08:29 [ 353 ] DEBUG : Setup directory for instance: main_node (cluster.py:2657, start) 2026-10-31 00:08:29 [ 353 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_system_start_stop_listen/configs/cluster.xml', '/ClickHouse/tests/integration/test_system_start_stop_listen/configs/protocols.xml', '/ClickHouse/tests/integration/test_system_start_stop_listen/configs/server.crt', '/ClickHouse/tests/integration/test_system_start_stop_listen/configs/server.key'] to /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/configs/config.d (cluster.py:4383, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/database (cluster.py:4400, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs (cluster.py:4411, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4487, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Setup directory for instance: backup_node (cluster.py:2657, start) 2026-10-31 00:08:29 [ 353 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_system_start_stop_listen/configs/cluster.xml'] to /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/configs/config.d (cluster.py:4383, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/database (cluster.py:4400, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/logs (cluster.py:4411, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4487, create_dir) 2026-10-31 00:08:29 [ 353 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2741', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env (cluster.py:78, _create_env_file) 2026-10-31 00:08:29 [ 353 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-31 00:08:29 [ 353 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-31 00:08:29 [ 353 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-31 00:08:29 [ 353 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-31 00:08:29 [ 353 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:546, _make_request) 2026-10-31 00:08:29 [ 353 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/docker-compose.yml', 'pull'] (cluster.py:105, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling main_node ... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling backup_node ... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling backup_node ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling main_node ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling backup_node ... digest: sha256:64754e5d47ef193df8... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling backup_node ... status: image is up to date for a... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling backup_node ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:64754e5d47ef193df8... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:64754e5d47ef193df8... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling main_node ... digest: sha256:64754e5d47ef193df8... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling main_node ... status: image is up to date for a... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:64754e5d47ef193df8... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling main_node ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:40 [ 353 ] DEBUG : Setup ZooKeeper (cluster.py:2699, start) 2026-10-31 00:08:40 [ 353 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/log', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/config', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/log', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/config', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/coordination', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/log', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/config', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/coordination'] (cluster.py:2700, start) 2026-10-31 00:08:40 [ 353 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/compose/docker_compose_keeper.yml', '--verbose', 'up', '-d'] (cluster.py:105, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.config.config.find: Using configuration files: /compose/docker_compose_keeper.yml (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.docker_client.get_client: docker-compose version 1.29.2, build unknown (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:docker-py version: (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:CPython version: 3.10.12 (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:OpenSSL version: OpenSSL 3.0.2 15 Mar 2022 (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker base_url: http+docker://localhost (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker version: Platform={'Name': 'Docker Engine - Community'}, Components=[{'Name': 'Engine', 'Version': '23.0.6', 'Details': {'ApiVersion': '1.42', 'Arch': 'amd64', 'BuildTime': '2023-05-05T21:18:13.000000000+00:00', 'Experimental': 'false', 'GitCommit': '9dbdbd4', 'GoVersion': 'go1.19.9', 'KernelVersion': '5.15.0-130-generic', 'MinAPIVersion': '1.12', 'Os': 'linux'}}, {'Name': 'containerd', 'Version': 'v2.4.2', 'Details': {'GitCommit': 'b7a25261e029d68978bbf290df0a62fc819b3c51'}}, {'Name': 'runc', 'Version': '1.5.2', 'Details': {'GitCommit': 'v1.5.2-0-g29dd3dc2'}}, {'Name': 'docker-init', 'Version': '0.19.0', 'Details': {'GitCommit': 'de40ad0'}}], Version=23.0.6, ApiVersion=1.42, MinAPIVersion=1.12, GitCommit=9dbdbd4, GoVersion=go1.19.9, Os=linux, Arch=amd64, KernelVersion=5.15.0-130-generic, BuildTime=2023-05-05T21:18:13.000000000+00:00 (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info <- () (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info -> {'Architecture': 'x86_64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'BridgeNfIp6tables': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'BridgeNfIptables': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CPUSet': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CPUShares': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CgroupDriver': 'cgroupfs', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CgroupVersion': '2', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'ContainerdCommit': {'Expected': 'b7a25261e029d68978bbf290df0a62fc819b3c51', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'ID': 'b7a25261e029d68978bbf290df0a62fc819b3c51'}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Containers': 0, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.network.ensure: Creating network "roottestsystemstartstoplisten_default" with the default driver (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network <- (name='roottestsystemstartstoplisten_default', driver=None, options=None, ipam=None, internal=False, enable_ipv6=False, labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.network': 'default', 'com.docker.compose.version': '1.29.2'}, attachable=True, check_duplicate=True) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network -> {'Id': '1f9d2a49e6119b1272f1f1183e9573ca3631cdbb69b6281bca2916d0d80bf23d', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Warning': ''} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {, , } (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo3_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestsystemstartstoplisten', service='zoo3', number=1)} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestsystemstartstoplisten', service='zoo3', number=1) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo1_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestsystemstartstoplisten', service='zoo1', number=1)} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestsystemstartstoplisten', service='zoo1', number=1) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo2_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestsystemstartstoplisten', service='zoo2', number=1)} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestsystemstartstoplisten', service='zoo2', number=1) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: b2a8157af720acb1a3b433156d9cbe65870deca666f32f44a77659765c79ad56 (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestsystemstartstoplisten_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse-keeper', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config1.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:2741', user='0', volumes={}, name='roottestsystemstartstoplisten_zoo1_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.service': 'zoo1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'b2a8157af720acb1a3b433156d9cbe65870deca666f32f44a77659765c79ad56'}, host_config={'NetworkMode': 'roottestsystemstartstoplisten_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestsystemstartstoplisten_default': {'Aliases': ['zoo1'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: e1f0ca88097afd78ffcd42ba2a6c066d82991f3435fc424880f7139a026e061f (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestsystemstartstoplisten_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse-keeper', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config3.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:2741', user='0', volumes={}, name='roottestsystemstartstoplisten_zoo3_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.service': 'zoo3', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'e1f0ca88097afd78ffcd42ba2a6c066d82991f3435fc424880f7139a026e061f'}, host_config={'NetworkMode': 'roottestsystemstartstoplisten_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestsystemstartstoplisten_default': {'Aliases': ['zoo3'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2741') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 4a3645715cb1495c8daa7c8d3e6b6890e8435b3a54dde1ded07173e7aab50a9c (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestsystemstartstoplisten_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config2.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:2741', user='0', volumes={}, name='roottestsystemstartstoplisten_zoo2_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.service': 'zoo2', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '4a3645715cb1495c8daa7c8d3e6b6890e8435b3a54dde1ded07173e7aab50a9c'}, host_config={'NetworkMode': 'roottestsystemstartstoplisten_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestsystemstartstoplisten_default': {'Aliases': ['zoo2'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '04d166b56e4232aceb80986d5814703f773d0b83c089e537f9846a0765406656', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('04d166b56e4232aceb80986d5814703f773d0b83c089e537f9846a0765406656') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config1.xml', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('04d166b56e4232aceb80986d5814703f773d0b83c089e537f9846a0765406656', 'roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '88236aa7dc1a8f28faf4a675d8cfafc44c7991b5320a0e0710701c13790a2e8a', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('88236aa7dc1a8f28faf4a675d8cfafc44c7991b5320a0e0710701c13790a2e8a') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config3.xml', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '566d08f0f073eda5945c817e45172bc59f561370cc6418a0aff303276a55f06b', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('88236aa7dc1a8f28faf4a675d8cfafc44c7991b5320a0e0710701c13790a2e8a', 'roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('04d166b56e4232aceb80986d5814703f773d0b83c089e537f9846a0765406656', 'roottestsystemstartstoplisten_default', aliases=['04d166b56e42', 'zoo1'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('566d08f0f073eda5945c817e45172bc59f561370cc6418a0aff303276a55f06b') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config2.xml', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('566d08f0f073eda5945c817e45172bc59f561370cc6418a0aff303276a55f06b', 'roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('88236aa7dc1a8f28faf4a675d8cfafc44c7991b5320a0e0710701c13790a2e8a', 'roottestsystemstartstoplisten_default', aliases=['zoo3', '88236aa7dc1a'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('04d166b56e4232aceb80986d5814703f773d0b83c089e537f9846a0765406656') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('566d08f0f073eda5945c817e45172bc59f561370cc6418a0aff303276a55f06b', 'roottestsystemstartstoplisten_default', aliases=['566d08f0f073', 'zoo2'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('88236aa7dc1a8f28faf4a675d8cfafc44c7991b5320a0e0710701c13790a2e8a') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('566d08f0f073eda5945c817e45172bc59f561370cc6418a0aff303276a55f06b') (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestsystemstartstoplisten', service='zoo1', number=1) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo1_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestsystemstartstoplisten', service='zoo2', number=1) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo2_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestsystemstartstoplisten', service='zoo3', number=1) (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo3_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2026-10-31 00:08:42 [ 353 ] DEBUG : Wait ZooKeeper to start (cluster.py:2337, wait_zookeeper_to_start) 2026-10-31 00:08:42 [ 353 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:1971, get_instance_ip) 2026-10-31 00:08:42 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_zoo1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:42 [ 353 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.1.2, port:2181, use_ssl:False (cluster.py:3120, get_kazoo_client) 2026-10-31 00:08:42 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:42 [ 353 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-31 00:08:42 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:42 [ 353 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-31 00:08:42 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:42 [ 353 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-31 00:08:42 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:42 [ 353 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-31 00:08:43 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:43 [ 353 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-31 00:08:44 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:44 [ 353 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-10-31 00:08:46 [ 353 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-10-31 00:08:46 [ 353 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:1971, get_instance_ip) 2026-10-31 00:08:46 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_zoo2_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:46 [ 353 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.1.4, port:2181, use_ssl:False (cluster.py:3120, get_kazoo_client) 2026-10-31 00:08:46 [ 353 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-10-31 00:08:46 [ 353 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-10-31 00:08:46 [ 353 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:1971, get_instance_ip) 2026-10-31 00:08:46 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_zoo3_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:46 [ 353 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False (cluster.py:3120, get_kazoo_client) 2026-10-31 00:08:46 [ 353 ] INFO : Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-10-31 00:08:46 [ 353 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-10-31 00:08:46 [ 353 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-10-31 00:08:46 [ 353 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-10-31 00:08:47 [ 353 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-10-31 00:08:47 [ 353 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-10-31 00:08:47 [ 353 ] DEBUG : All instances of ZooKeeper started (cluster.py:2345, wait_zookeeper_to_start) 2026-10-31 00:08:47 [ 353 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env --project-name roottestsystemstartstoplisten --file /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/docker-compose.yml --file /compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/docker-compose.yml up -d --no-recreate') (cluster.py:2980, start) 2026-10-31 00:08:47 [ 353 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/docker-compose.yml', 'up', '-d', '--no-recreate'] (cluster.py:105, run_and_check) 2026-10-31 00:08:48 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_main_node_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:48 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_backup_node_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:08:48 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_backup_node_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:48 [ 353 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_main_node_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:08:48 [ 353 ] DEBUG : ClickHouse instance created (cluster.py:2988, start) 2026-10-31 00:08:48 [ 353 ] DEBUG : get_instance_ip instance_name=main_node (cluster.py:1971, get_instance_ip) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_main_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : Waiting for ClickHouse start in main_node, ip: 172.16.1.6... (cluster.py:2995, start) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_main_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:48 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:49 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:50 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/3b1d3b2a9d6f74ba70cbb6459353b4c23c147983a4dc0e3323b515ea872a3df5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:50 [ 353 ] DEBUG : ClickHouse main_node started (cluster.py:2999, start) 2026-10-31 00:08:50 [ 353 ] DEBUG : get_instance_ip instance_name=backup_node (cluster.py:1971, get_instance_ip) 2026-10-31 00:08:50 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_backup_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:50 [ 353 ] DEBUG : Waiting for ClickHouse start in backup_node, ip: 172.16.1.5... (cluster.py:2995, start) 2026-10-31 00:08:50 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_backup_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:50 [ 353 ] DEBUG : http://localhost:None "GET /v1.42/containers/cf4dfea44f80b183922827670630fb90d69128eb855dd373b36bff81a975e43c/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:50 [ 353 ] DEBUG : ClickHouse backup_node started (cluster.py:2999, start) ------------------------------ Captured log call ------------------------------- 2026-10-31 00:08:50 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:08:50 [ 353 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2026-10-31 00:08:51 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:08:51 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:51 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:08:51 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:08:51 [ 353 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES ALL EXCEPT MYSQL, CUSTOM 'tcp' on main_node (cluster.py:3423, query) 2026-10-31 00:09:00 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3495, query_and_get_error) 2026-10-31 00:09:01 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:01 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:01 [ 353 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES ALL EXCEPT TCP on backup_node (cluster.py:3423, query) 2026-10-31 00:09:01 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3495, query_and_get_error) 2026-10-31 00:09:01 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:01 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:01 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:02 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:02 [ 353 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES ALL on backup_node (cluster.py:3423, query) 2026-10-31 00:09:02 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:02 [ 353 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2026-10-31 00:09:03 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:03 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:03 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:03 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:03 [ 353 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES DEFAULT EXCEPT TCP on main_node (cluster.py:3423, query) 2026-10-31 00:09:04 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:05 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:05 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:05 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:05 [ 353 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES DEFAULT EXCEPT HTTP on backup_node (cluster.py:3423, query) 2026-10-31 00:09:05 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:05 [ 353 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2026-10-31 00:09:06 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:06 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:06 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:06 [ 353 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES ALL on backup_node (cluster.py:3423, query) 2026-10-31 00:09:06 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:06 [ 353 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2026-10-31 00:09:07 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:07 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:07 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:07 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:07 [ 353 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES CUSTOM EXCEPT CUSTOM 'tcp' on main_node (cluster.py:3423, query) 2026-10-31 00:09:08 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:08 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:08 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:08 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:08 [ 353 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES CUSTOM on main_node (cluster.py:3423, query) 2026-10-31 00:09:09 [ 353 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES CUSTOM EXCEPT CUSTOM 'tcp' on backup_node (cluster.py:3423, query) 2026-10-31 00:09:09 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:09 [ 353 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2026-10-31 00:09:10 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:10 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:10 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:10 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:10 [ 353 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES ALL on backup_node (cluster.py:3423, query) 2026-10-31 00:09:10 [ 353 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2026-10-31 00:09:11 [ 353 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2026-10-31 00:09:11 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8123 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:11 [ 353 ] DEBUG : http://172.16.1.6:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2026-10-31 00:09:11 [ 353 ] DEBUG : Starting new HTTP connection (1): 172.16.1.6:8124 (connectionpool.py:244, _new_conn) 2026-10-31 00:09:11 [ 353 ] DEBUG : http://172.16.1.6:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) --------------------------- Captured stderr teardown --------------------------- WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ ---------------------------- Captured log teardown ----------------------------- 2026-10-31 00:09:12 [ 353 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:105, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_main_node_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_backup_node_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo2_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo3_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo1_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_backup_node_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_main_node_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo3_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo2_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo1_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log* || true'] (cluster.py:105, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : grep in log called ================== (cluster.py:3875, grep_in_log) 2026-10-31 00:09:34 [ 353 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log ] && zgrep -A1000 -a "==================" /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/logs/stderr.log* || true'] (cluster.py:105, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b540000eb68 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2547:16 (clickhouse+0xfadb977) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb977) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb977) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b540000eb68 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in __tsan_memcpy (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 1 at 0x7b540000ec1f by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 (clickhouse+0xfadb980) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2551:11 (clickhouse+0xfadb980) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb980) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb980) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b540000ec18 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 in std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 1 at 0x7b540000ec08 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::char_traits::assign(char&, char const&) build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 (clickhouse+0xfadb98d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2552:5 (clickhouse+0xfadb98d) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb98d) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb98d) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b540000ec08 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 in std::__1::char_traits::assign(char&, char const&) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b540000ec38 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::release[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 (clickhouse+0xfadba10) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:15 (clickhouse+0xfadba10) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba10) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b540000ec38 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 in std::__1::unique_ptr>::release[abi:v15000]() (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b540000eb98 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadba24) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba24) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba24) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b540000eb98 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b0400002cb8 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b0400002cb8 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 16 at 0x7b0400002cb0 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2125:24 (clickhouse+0xfaccc32) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaccc32) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaccc32) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaccc32) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaccc32) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2118:13 (clickhouse+0xfabc442) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b4000004718 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #34 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #35 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous atomic read of size 4 at 0x7b4000004718 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b4400027398 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b4400027398 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b0400002cb0 by thread T2: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b0400002cb0 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T2 'TCPHandler' (tid=9, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:LLVMSymbolizer: error reading file: No such file or directory (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Read of size 8 at 0x7ffd7fcb7440 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::vector>::size[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 (clickhouse+0xfac7c01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:756:77 (clickhouse+0xfac7c01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7c01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7c01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7c01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7c01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous write of size 8 at 0x7ffd7fcb7440 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:834:18 (clickhouse+0xfadb878) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb878) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb878) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac38b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2422:5 (clickhouse+0xfac38b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is stack of main thread. (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is global '??' at 0x7ffd7fc98000 ([stack]+0x1f440) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 in std::__1::vector>::size[abi:v15000]() const (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b540000ecd8 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadb76a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb76a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b540000ecd8 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b0400003498 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b0400003498 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Location is heap block of size 16 at 0x7b0400003490 allocated by thread T259: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2283:24 (clickhouse+0xfaced31) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaced31) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaced31) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaced31) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaced31) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2277:13 (clickhouse+0xfabd0b1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1558:9 (clickhouse+0xfacc83f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc83f) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc83f) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc83f) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc83f) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909748) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909748) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::Context::startServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3832:5 (clickhouse+0x18909748) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:627:27 (clickhouse+0x1961c92f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::__1::shared_ptr, std::__1::function, std::__1::optional const&, std::__1::function) build_docker/./src/Interpreters/executeQuery.cpp:1322:34 (clickhouse+0x19a5bddd) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:483:9 (clickhouse+0x189aa43f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 DB::DDLWorker::processTask(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:646:17 (clickhouse+0x189a7e1d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 DB::DDLWorker::scheduleTasks(bool) build_docker/./src/Interpreters/DDLWorker.cpp:426:13 (clickhouse+0x189a5932) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::DDLWorker::runMainThread() build_docker/./src/Interpreters/DDLWorker.cpp:1126:13 (clickhouse+0x1899f309) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 decltype(*std::declval().*std::declval()()) std::__1::__invoke[abi:v15000](void (DB::DDLWorker::*&)(), DB::DDLWorker*&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:359:23 (clickhouse+0x189b7dbf) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::__1::tuple&, std::__1::__tuple_indices<0ul>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0x189b7dbf) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 decltype(auto) std::__1::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::__1::tuple&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0x189b7dbf) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0x189b7dbf) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 decltype(std::declval()(std::declval())) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0x189b7d01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0x189b7d01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0x189b7d01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #34 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0x189b7d01) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #35 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #36 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #37 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #38 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #39 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #40 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #41 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T259 'DDLWorker' (tid=266, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x189b7b99) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__unique_if>::__unique_single std::__1::make_unique[abi:v15000], void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:32 (clickhouse+0x1899ea6f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::DDLWorker::startup() build_docker/./src/Interpreters/DDLWorker.cpp:126:19 (clickhouse+0x1899ea6f) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 DB::Context::setDDLWorker(std::__1::unique_ptr>) build_docker/./src/Interpreters/Context.cpp:2773:17 (clickhouse+0x188fc7b5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1877:29 (clickhouse+0xfab2fac) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b4000008318 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #34 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #35 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #36 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #37 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #38 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #39 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #40 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous atomic read of size 4 at 0x7b4000008318 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b4400070458 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b4400070458 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b0400003490 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b0400003490 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b4000008118 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af3c281) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:23:1 (clickhouse+0x1af3c281) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #34 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #35 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #36 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #37 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #38 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #39 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #40 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #41 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous atomic read of size 4 at 0x7b4000008118 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:WARNING: ThreadSanitizer: data race (pid=1) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Write of size 8 at 0x7b4400100058 by thread T288: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Previous read of size 8 at 0x7b4400100058 by thread T256 (mutexes: write M0): (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Mutex M0 (0x7ffd7fcb7038) created at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout: (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:================== (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Stdout:ThreadSanitizer: reported 17 warnings (cluster.py:113, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : grep result ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000eb68 by thread T2: #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2547:16 (clickhouse+0xfadb977) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb977) #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb977) #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000eb68 by thread T256 (mutexes: write M0): #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in __tsan_memcpy ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 1 at 0x7b540000ec1f by thread T2: #0 std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 (clickhouse+0xfadb980) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2551:11 (clickhouse+0xfadb980) #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb980) #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb980) #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ec18 by thread T256 (mutexes: write M0): #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 in std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 1 at 0x7b540000ec08 by thread T2: #0 std::__1::char_traits::assign(char&, char const&) build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 (clickhouse+0xfadb98d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2552:5 (clickhouse+0xfadb98d) #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb98d) #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb98d) #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ec08 by thread T256 (mutexes: write M0): #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 in std::__1::char_traits::assign(char&, char const&) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000ec38 by thread T2: #0 std::__1::unique_ptr>::release[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 (clickhouse+0xfadba10) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:15 (clickhouse+0xfadba10) #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba10) #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ec38 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 in std::__1::unique_ptr>::release[abi:v15000]() ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000eb98 by thread T2: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadba24) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba24) #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba24) #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000eb98 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400002cb8 by thread T2: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #6 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #7 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #8 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400002cb8 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 16 at 0x7b0400002cb0 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2125:24 (clickhouse+0xfaccc32) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaccc32) #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaccc32) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaccc32) #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaccc32) #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2118:13 (clickhouse+0xfabc442) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4000004718 by thread T2: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #13 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #14 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #15 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #17 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #18 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #20 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #21 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #22 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #23 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #25 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #26 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous atomic read of size 4 at 0x7b4000004718 by thread T256 (mutexes: write M0): #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4400027398 by thread T2: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #9 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #10 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #11 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b4400027398 by thread T256 (mutexes: write M0): #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400002cb0 by thread T2: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #4 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #5 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #6 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #8 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #11 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #12 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #13 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #14 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #16 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #17 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400002cb0 by thread T256 (mutexes: write M0): #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== LLVMSymbolizer: error reading file: No such file or directory ================== WARNING: ThreadSanitizer: data race (pid=1) Read of size 8 at 0x7ffd7fcb7440 by thread T256 (mutexes: write M0): #0 std::__1::vector>::size[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 (clickhouse+0xfac7c01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:756:77 (clickhouse+0xfac7c01) #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7c01) #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7c01) #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7c01) #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7c01) #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Previous write of size 8 at 0x7ffd7fcb7440 by thread T288: #0 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:834:18 (clickhouse+0xfadb878) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb878) #2 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb878) #3 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac38b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2422:5 (clickhouse+0xfac38b9) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #7 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #8 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #9 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #10 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #12 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #13 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Location is stack of main thread. Location is global '??' at 0x7ffd7fc98000 ([stack]+0x1f440) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 in std::__1::vector>::size[abi:v15000]() const ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000ecd8 by thread T288: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadb76a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb76a) #2 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb76a) #3 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb76a) #4 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb76a) #5 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb76a) #6 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb76a) #7 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb76a) #8 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb76a) #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ecd8 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400003498 by thread T288: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #6 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #7 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #8 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #9 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #10 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #11 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #12 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #13 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #14 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #16 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #18 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #19 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #20 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #21 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #23 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #24 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400003498 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 16 at 0x7b0400003490 allocated by thread T259: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2283:24 (clickhouse+0xfaced31) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaced31) #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaced31) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaced31) #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaced31) #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2277:13 (clickhouse+0xfabd0b1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1558:9 (clickhouse+0xfacc83f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc83f) #14 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc83f) #15 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc83f) #16 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc83f) #17 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909748) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909748) #19 DB::Context::startServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3832:5 (clickhouse+0x18909748) #20 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:627:27 (clickhouse+0x1961c92f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::__1::shared_ptr, std::__1::function, std::__1::optional const&, std::__1::function) build_docker/./src/Interpreters/executeQuery.cpp:1322:34 (clickhouse+0x19a5bddd) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:483:9 (clickhouse+0x189aa43f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 DB::DDLWorker::processTask(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:646:17 (clickhouse+0x189a7e1d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::DDLWorker::scheduleTasks(bool) build_docker/./src/Interpreters/DDLWorker.cpp:426:13 (clickhouse+0x189a5932) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::DDLWorker::runMainThread() build_docker/./src/Interpreters/DDLWorker.cpp:1126:13 (clickhouse+0x1899f309) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 decltype(*std::declval().*std::declval()()) std::__1::__invoke[abi:v15000](void (DB::DDLWorker::*&)(), DB::DDLWorker*&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:359:23 (clickhouse+0x189b7dbf) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::__1::tuple&, std::__1::__tuple_indices<0ul>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0x189b7dbf) #29 decltype(auto) std::__1::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::__1::tuple&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0x189b7dbf) #30 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0x189b7dbf) #31 decltype(std::declval()(std::declval())) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0x189b7d01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0x189b7d01) #33 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0x189b7d01) #34 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0x189b7d01) #35 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #37 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #38 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #39 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #40 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #41 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T259 'DDLWorker' (tid=266, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x189b7b99) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 std::__1::__unique_if>::__unique_single std::__1::make_unique[abi:v15000], void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:32 (clickhouse+0x1899ea6f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::DDLWorker::startup() build_docker/./src/Interpreters/DDLWorker.cpp:126:19 (clickhouse+0x1899ea6f) #8 DB::Context::setDDLWorker(std::__1::unique_ptr>) build_docker/./src/Interpreters/Context.cpp:2773:17 (clickhouse+0x188fc7b5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1877:29 (clickhouse+0xfab2fac) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4000008318 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #13 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #14 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #15 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #16 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #17 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #18 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #19 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #20 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #21 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #23 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #25 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #26 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #27 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #28 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #30 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #31 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #37 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #38 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #39 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #40 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous atomic read of size 4 at 0x7b4000008318 by thread T256 (mutexes: write M0): #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4400070458 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b4400070458 by thread T256 (mutexes: write M0): #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400003490 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #5 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #6 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #7 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #8 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #9 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #10 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #11 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400003490 by thread T256 (mutexes: write M0): #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4000008118 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af3c281) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:23:1 (clickhouse+0x1af3c281) #6 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #11 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #12 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #14 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #15 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #16 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #17 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #18 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #19 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #20 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #21 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #22 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #24 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #26 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #27 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #28 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #29 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #31 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #32 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #37 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #38 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #39 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #40 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #41 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous atomic read of size 4 at 0x7b4000008118 by thread T256 (mutexes: write M0): #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4400100058 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b4400100058 by thread T256 (mutexes: write M0): #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ThreadSanitizer: reported 17 warnings (cluster.py:3897, grep_in_log) 2026-10-31 00:09:34 [ 353 ] ERROR : Sanitizer in instance main_node log ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000eb68 by thread T2: #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2547:16 (clickhouse+0xfadb977) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb977) #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb977) #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000eb68 by thread T256 (mutexes: write M0): #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in __tsan_memcpy ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 1 at 0x7b540000ec1f by thread T2: #0 std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 (clickhouse+0xfadb980) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2551:11 (clickhouse+0xfadb980) #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb980) #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb980) #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ec18 by thread T256 (mutexes: write M0): #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/string:1570:37 in std::__1::basic_string, std::__1::allocator>::__set_short_size[abi:v15000](unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 1 at 0x7b540000ec08 by thread T2: #0 std::__1::char_traits::assign(char&, char const&) build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 (clickhouse+0xfadb98d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::__move_assign[abi:v15000](std::__1::basic_string, std::__1::allocator>&, std::__1::integral_constant) build_docker/./contrib/llvm-project/libcxx/include/string:2552:5 (clickhouse+0xfadb98d) #2 std::__1::basic_string, std::__1::allocator>::operator=[abi:v15000](std::__1::basic_string, std::__1::allocator>&&) build_docker/./contrib/llvm-project/libcxx/include/string:2562:5 (clickhouse+0xfadb98d) #3 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadb98d) #4 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #6 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #9 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #11 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #12 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #14 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #15 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ec08 by thread T256 (mutexes: write M0): #0 __tsan_memcpy (clickhouse+0x7c31040) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::basic_string, std::__1::allocator>::basic_string(std::__1::basic_string, std::__1::allocator> const&) build_docker/./contrib/llvm-project/libcxx/include/string:2013:26 (clickhouse+0xfac7ef9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:60 (clickhouse+0xfac7ef9) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7ef9) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7ef9) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7ef9) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7ef9) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__string/char_traits.h:198:73 in std::__1::char_traits::assign(char&, char const&) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000ec38 by thread T2: #0 std::__1::unique_ptr>::release[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 (clickhouse+0xfadba10) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:15 (clickhouse+0xfadba10) #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba10) #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ec38 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:296:20 in std::__1::unique_ptr>::release[abi:v15000]() ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000eb98 by thread T2: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadba24) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba24) #2 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba24) #3 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #5 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #6 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #8 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #9 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #10 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #11 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #13 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #14 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000eb98 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400002cb8 by thread T2: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #6 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #7 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #8 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400002cb8 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 16 at 0x7b0400002cb0 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2125:24 (clickhouse+0xfaccc32) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaccc32) #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaccc32) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaccc32) #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_0, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaccc32) #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2118:13 (clickhouse+0xfabc442) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4000004718 by thread T2: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #13 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #14 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #15 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #17 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #18 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #20 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #21 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #22 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #23 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #25 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #26 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous atomic read of size 4 at 0x7b4000004718 by thread T256 (mutexes: write M0): #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4400027398 by thread T2: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #9 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #10 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #11 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b4400027398 by thread T256 (mutexes: write M0): #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400002cb0 by thread T2: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadba3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadba3e) #4 std::__1::unique_ptr>::operator=[abi:v15000](std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225:5 (clickhouse+0xfadba3e) #5 DB::ProtocolServerAdapter::operator=(DB::ProtocolServerAdapter&&) build_docker/./src/Server/ProtocolServerAdapter.h:23:78 (clickhouse+0xfadba3e) #6 std::__1::__wrap_iter std::__1::remove_if, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::__wrap_iter, std::__1::__wrap_iter, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/__algorithm/remove_if.h:34:26 (clickhouse+0xfac3b62) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:13 (clickhouse+0xfac3b62) #8 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b62) #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #11 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #12 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #13 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #14 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #16 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #17 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400002cb0 by thread T256 (mutexes: write M0): #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T2 'TCPHandler' (tid=9, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f65f412) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:237:12 (clickhouse+0x1f65f412) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:742:22 (clickhouse+0xfaa4584) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== LLVMSymbolizer: error reading file: No such file or directory ================== WARNING: ThreadSanitizer: data race (pid=1) Read of size 8 at 0x7ffd7fcb7440 by thread T256 (mutexes: write M0): #0 std::__1::vector>::size[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 (clickhouse+0xfac7c01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:756:77 (clickhouse+0xfac7c01) #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7c01) #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7c01) #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7c01) #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7c01) #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Previous write of size 8 at 0x7ffd7fcb7440 by thread T288: #0 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:834:18 (clickhouse+0xfadb878) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb878) #2 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb878) #3 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac38b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2422:5 (clickhouse+0xfac38b9) #5 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #7 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #8 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #9 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #10 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #12 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #13 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #19 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Location is stack of main thread. Location is global '??' at 0x7ffd7fc98000 ([stack]+0x1f440) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/vector:537:46 in std::__1::vector>::size[abi:v15000]() const ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b540000ecd8 by thread T288: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0xfadb76a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb76a) #2 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb76a) #3 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb76a) #4 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb76a) #5 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb76a) #6 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb76a) #7 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb76a) #8 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb76a) #9 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #11 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #13 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #14 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #15 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #16 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #18 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #19 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b540000ecd8 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0xfac7f92) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:44 (clickhouse+0xfac7f92) #2 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f92) #3 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f92) #4 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f92) #5 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f92) #6 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f92) #7 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #15 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #16 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #17 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #18 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #19 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #20 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #22 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #23 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #25 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #26 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 640 at 0x7b540000eb00 allocated by main thread: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 void* std::__1::__libcpp_operator_new[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:246:10 (clickhouse+0xfad367a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/new:272:10 (clickhouse+0xfad367a) #3 std::__1::allocator::allocate[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (clickhouse+0xfad367a) #4 std::__1::allocator::allocate_at_least[abi:v15000](unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (clickhouse+0xfad367a) #5 std::__1::allocation_result>::pointer> std::__1::allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (clickhouse+0xfad367a) #6 auto std::__1::__allocate_at_least[abi:v15000]>(std::__1::allocator&, unsigned long) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (clickhouse+0xfad367a) #7 std::__1::__split_buffer&>::__split_buffer(unsigned long, unsigned long, std::__1::allocator&) build_docker/./contrib/llvm-project/libcxx/include/__split_buffer:316:29 (clickhouse+0xfad367a) #8 void std::__1::vector>::__push_back_slow_path(DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1535:49 (clickhouse+0xfad367a) #9 std::__1::vector>::push_back[abi:v15000](DB::ProtocolServerAdapter&&) build_docker/./contrib/llvm-project/libcxx/include/vector:1567:9 (clickhouse+0xfa9e367) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:17 (clickhouse+0xfa9e367) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2234:13 (clickhouse+0xfabcdd1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1815:13 (clickhouse+0xfab2a2b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400003498 by thread T288: #0 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 (clickhouse+0x1af032b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032b4) #2 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #3 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032b4) #4 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #6 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #7 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #8 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #9 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #10 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #11 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #12 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #13 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #14 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #16 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #18 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #19 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #20 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #21 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #23 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #24 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400003498 by thread T256 (mutexes: write M0): #0 std::__1::unique_ptr>::operator->[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274:19 (clickhouse+0x1af034da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:53 (clickhouse+0x1af034da) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Location is heap block of size 16 at 0x7b0400003490 allocated by thread T259: #0 operator new(unsigned long) (clickhouse+0x7c73d87) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__unique_if::__unique_single std::__1::make_unique[abi:v15000]>>(std::__1::unique_ptr>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:28 (clickhouse+0x1af02b86) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::ProtocolServerAdapter(std::__1::basic_string, std::__1::allocator> const&, char const*, std::__1::basic_string, std::__1::allocator> const&, std::__1::unique_ptr>) build_docker/./src/Server/ProtocolServerAdapter.cpp:36:12 (clickhouse+0x1af02b86) #3 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7::operator()(unsigned short) const build_docker/./programs/server/Server.cpp:2283:24 (clickhouse+0xfaced31) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfaced31) #5 DB::ProtocolServerAdapter std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short>(DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7&, unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfaced31) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>::operator()[abi:v15000](unsigned short&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfaced31) #7 DB::ProtocolServerAdapter std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&)::$_7, DB::ProtocolServerAdapter (unsigned short)>>(std::__1::__function::__policy_storage const*, unsigned short) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfaced31) #8 std::__1::__function::__policy_func::operator()[abi:v15000](unsigned short&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfa9e290) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function::operator()(unsigned short) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfa9e290) #10 DB::Server::createServer(Poco::Util::AbstractConfiguration&, std::__1::basic_string, std::__1::allocator> const&, char const*, bool, bool, std::__1::vector>&, std::__1::function&&) const build_docker/./programs/server/Server.cpp:319:27 (clickhouse+0xfa9e290) #11 DB::Server::createServers(Poco::Util::AbstractConfiguration&, std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::__1::vector>&, bool, DB::ServerType const&) build_docker/./programs/server/Server.cpp:2277:13 (clickhouse+0xfabd0b1) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1558:9 (clickhouse+0xfacc83f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc83f) #14 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc83f) #15 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc83f) #16 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_11, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc83f) #17 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909748) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909748) #19 DB::Context::startServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3832:5 (clickhouse+0x18909748) #20 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:627:27 (clickhouse+0x1961c92f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #21 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::__1::shared_ptr, std::__1::function, std::__1::optional const&, std::__1::function) build_docker/./src/Interpreters/executeQuery.cpp:1322:34 (clickhouse+0x19a5bddd) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:483:9 (clickhouse+0x189aa43f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 DB::DDLWorker::processTask(DB::DDLTaskBase&, std::__1::shared_ptr const&) build_docker/./src/Interpreters/DDLWorker.cpp:646:17 (clickhouse+0x189a7e1d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::DDLWorker::scheduleTasks(bool) build_docker/./src/Interpreters/DDLWorker.cpp:426:13 (clickhouse+0x189a5932) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::DDLWorker::runMainThread() build_docker/./src/Interpreters/DDLWorker.cpp:1126:13 (clickhouse+0x1899f309) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 decltype(*std::declval().*std::declval()()) std::__1::__invoke[abi:v15000](void (DB::DDLWorker::*&)(), DB::DDLWorker*&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:359:23 (clickhouse+0x189b7dbf) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::__1::tuple&, std::__1::__tuple_indices<0ul>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0x189b7dbf) #29 decltype(auto) std::__1::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::__1::tuple&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0x189b7dbf) #30 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0x189b7dbf) #31 decltype(std::declval()(std::declval())) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0x189b7d01) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0x189b7d01) #33 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0x189b7d01) #34 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0x189b7d01) #35 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #37 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #38 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #39 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #40 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #41 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T259 'DDLWorker' (tid=266, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x189b7b99) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 std::__1::__unique_if>::__unique_single std::__1::make_unique[abi:v15000], void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:32 (clickhouse+0x1899ea6f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::DDLWorker::startup() build_docker/./src/Interpreters/DDLWorker.cpp:126:19 (clickhouse+0x1899ea6f) #8 DB::Context::setDDLWorker(std::__1::unique_ptr>) build_docker/./src/Interpreters/Context.cpp:2773:17 (clickhouse+0x188fc7b5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1877:29 (clickhouse+0xfab2fac) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #14 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303:20 in std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4000008318 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c41) #6 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #8 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #9 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #11 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #13 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #14 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #15 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #16 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #17 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #18 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #19 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #20 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #21 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #23 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #25 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #26 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #27 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #28 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #30 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #31 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #37 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #38 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #39 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #40 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous atomic read of size 4 at 0x7b4000008318 by thread T256 (mutexes: write M0): #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4400070458 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af36c4e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b4400070458 by thread T256 (mutexes: write M0): #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b0400003490 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032e2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #5 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #6 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #7 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #8 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #9 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #10 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #11 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #12 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #14 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #15 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #16 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #17 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #18 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #19 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #21 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #22 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #24 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #27 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b0400003490 by thread T256 (mutexes: write M0): #0 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7f9e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7f9e) #2 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7f9e) #3 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7f9e) #4 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7f9e) #5 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7f9e) #6 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #8 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #9 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #12 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #13 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #14 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #15 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #16 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #17 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #18 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #19 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #21 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #22 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #24 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #25 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4000008118 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::Net::TCPServerDispatcher::~TCPServerDispatcher() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:78:1 (clickhouse+0x1f407446) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Net::TCPServerDispatcher::release() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:90:18 (clickhouse+0x1f4074da) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::Net::TCPServer::~TCPServer() build_docker/./base/poco/Net/src/TCPServer.cpp:91:17 (clickhouse+0x1f406485) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::TCPServer::~TCPServer() build_docker/./src/Server/TCPServer.h:13:7 (clickhouse+0x1af3c281) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:23:1 (clickhouse+0x1af3c281) #6 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #10 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #11 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #12 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #14 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #15 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #16 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #17 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #18 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #19 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #20 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #21 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #22 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #23 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #24 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #26 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #27 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #28 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #29 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #31 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #32 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #37 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #38 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #39 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #40 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #41 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous atomic read of size 4 at 0x7b4000008118 by thread T256 (mutexes: write M0): #0 int std::__1::__cxx_atomic_load[abi:v15000](std::__1::__cxx_atomic_base_impl const*, std::__1::memory_order) build_docker/./contrib/llvm-project/libcxx/include/atomic:958:12 (clickhouse+0x1f4081c0) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__atomic_base::load[abi:v15000](std::__1::memory_order) const build_docker/./contrib/llvm-project/libcxx/include/atomic:1588:17 (clickhouse+0x1f4081c0) #2 std::__1::__atomic_base::operator int[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/atomic:1592:53 (clickhouse+0x1f4081c0) #3 Poco::Net::TCPServerDispatcher::currentThreads() const build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:182:9 (clickhouse+0x1f4081c0) #4 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:23 (clickhouse+0x1f406a03) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #8 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #9 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #10 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #11 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #12 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #14 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #15 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #16 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #19 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #20 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #21 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #22 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #23 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #24 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #25 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #26 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #27 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #28 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #30 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #31 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ================== WARNING: ThreadSanitizer: data race (pid=1) Write of size 8 at 0x7b4400100058 by thread T288: #0 operator delete(void*, unsigned long) (clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::HTTPServer::~HTTPServer() build_docker/./src/Server/HTTP/HTTPServer.cpp:19:1 (clickhouse+0x1af3c2c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::default_delete::operator()[abi:v15000](DB::TCPServer*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x1af032d5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 std::__1::unique_ptr>::reset[abi:v15000](DB::TCPServer*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0x1af032d5) #4 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0x1af032d5) #5 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #6 DB::ProtocolServerAdapter::TCPServerAdapterImpl::~TCPServerAdapterImpl() build_docker/./src/Server/ProtocolServerAdapter.cpp:15:46 (clickhouse+0x1af032d5) #7 std::__1::default_delete::operator()[abi:v15000](DB::ProtocolServerAdapter::Impl*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0xfadb789) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 std::__1::unique_ptr>::reset[abi:v15000](DB::ProtocolServerAdapter::Impl*) build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (clickhouse+0xfadb789) #9 std::__1::unique_ptr>::~unique_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (clickhouse+0xfadb789) #10 DB::ProtocolServerAdapter::~ProtocolServerAdapter() build_docker/./src/Server/ProtocolServerAdapter.h:18:7 (clickhouse+0xfadb789) #11 void std::__1::__destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (clickhouse+0xfadb789) #12 void std::__1::destroy_at[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (clickhouse+0xfadb789) #13 void std::__1::allocator_traits>::destroy[abi:v15000](std::__1::allocator&, DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (clickhouse+0xfadb789) #14 std::__1::vector>::__base_destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:833:9 (clickhouse+0xfadb789) #15 std::__1::vector>::__destruct_at_end[abi:v15000](DB::ProtocolServerAdapter*) build_docker/./contrib/llvm-project/libcxx/include/vector:721:9 (clickhouse+0xfadb789) #16 std::__1::vector>::erase(std::__1::__wrap_iter, std::__1::__wrap_iter) build_docker/./contrib/llvm-project/libcxx/include/vector:1648:15 (clickhouse+0xfadb789) #17 std::__1::vector>::size_type std::__1::erase_if[abi:v15000], std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>>(std::__1::vector>&, std::__1::__bind_front_t>&, DB::ServerType const&) const::$_0, char const*>) build_docker/./contrib/llvm-project/libcxx/include/vector:3306:7 (clickhouse+0xfac3b81) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #18 DB::Server::stopServers(std::__1::vector>&, DB::ServerType const&) const build_docker/./programs/server/Server.cpp:2435:5 (clickhouse+0xfac3b81) #19 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10::operator()(DB::ServerType const&) const build_docker/./programs/server/Server.cpp:1553:9 (clickhouse+0xfacc75b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #20 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&>()(std::declval())) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfacc75b) #21 void std::__1::__invoke_void_return_wrapper::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10&, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfacc75b) #22 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>::operator()[abi:v15000](DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfacc75b) #23 void std::__1::__function::__policy_invoker::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_10, void (DB::ServerType const&)>>(std::__1::__function::__policy_storage const*, DB::ServerType const&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfacc75b) #24 std::__1::__function::__policy_func::operator()[abi:v15000](DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x18909828) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 std::__1::function::operator()(DB::ServerType const&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x18909828) #26 DB::Context::stopServers(DB::ServerType const&) const build_docker/./src/Interpreters/Context.cpp:3841:5 (clickhouse+0x18909828) #27 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:623:27 (clickhouse+0x1961ba8d) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #28 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1085:40 (clickhouse+0x19a586e5) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #29 DB::executeQuery(std::__1::basic_string, std::__1::allocator> const&, std::__1::shared_ptr, bool, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1224:30 (clickhouse+0x19a54238) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #30 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:496:24 (clickhouse+0x1af1680a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #31 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2159:9 (clickhouse+0x1af307a7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #32 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1f406ec2) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #33 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1f40773a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #34 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1f65eec6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #35 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #36 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Previous read of size 8 at 0x7b4400100058 by thread T256 (mutexes: write M0): #0 Poco::Net::TCPServer::currentThreads() const build_docker/./base/poco/Net/src/TCPServer.cpp:178:9 (clickhouse+0x1f4069fa) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 DB::ProtocolServerAdapter::TCPServerAdapterImpl::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.cpp:22:65 (clickhouse+0x1af034e3) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 DB::ProtocolServerAdapter::currentThreads() const build_docker/./src/Server/ProtocolServerAdapter.h:42:50 (clickhouse+0xfac7fa7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1::operator()() const build_docker/./programs/server/Server.cpp:762:89 (clickhouse+0xfac7fa7) #4 decltype(std::declval, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>()()) std::__1::__invoke[abi:v15000], std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfac7fa7) #5 std::__1::vector> std::__1::__invoke_void_return_wrapper>, false>::__call, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&>(DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:470:16 (clickhouse+0xfac7fa7) #6 std::__1::__function::__default_alloc_func, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfac7fa7) #7 std::__1::vector> std::__1::__function::__policy_invoker> ()>::__call_impl, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&)::$_1, std::__1::vector> ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfac7fa7) #8 std::__1::__function::__policy_func> ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb7f057) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 std::__1::function> ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb7f057) #10 DB::AsynchronousMetrics::update(std::__1::chrono::time_point>>) build_docker/./src/Common/AsynchronousMetrics.cpp:1549:37 (clickhouse+0xfb7f057) #11 DB::AsynchronousMetrics::run() build_docker/./src/Common/AsynchronousMetrics.cpp:354:13 (clickhouse+0xfb81636) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 DB::AsynchronousMetrics::start()::$_0::operator()() const build_docker/./src/Common/AsynchronousMetrics.cpp:273:62 (clickhouse+0xfb83d0a) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #13 decltype(std::declval()()) std::__1::__invoke[abi:v15000](DB::AsynchronousMetrics::start()::$_0&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/tuple:1789:1 (clickhouse+0xfb83d0a) #15 decltype(auto) std::__1::apply[abi:v15000]&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_docker/./contrib/llvm-project/libcxx/include/tuple:1798:1 (clickhouse+0xfb83d0a) #16 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_docker/./src/Common/ThreadPool.h:242:13 (clickhouse+0xfb83d0a) #17 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb83d0a) #18 void std::__1::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xfb83d0a) #19 std::__1::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xfb83d0a) #20 void std::__1::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xfb83d0a) #21 std::__1::__function::__policy_func::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0xfb036c6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #22 std::__1::function::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0xfb036c6) #23 ThreadPoolImpl::worker(std::__1::__list_iterator) build_docker/./src/Common/ThreadPool.cpp:426:13 (clickhouse+0xfb036c6) #24 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()::operator()() const build_docker/./src/Common/ThreadPool.cpp:179:73 (clickhouse+0xfb09871) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #25 decltype(std::declval()()) std::__1::__invoke[abi:v15000]::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(void&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xfb09871) #26 void std::__1::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>(std::__1::tuple::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_docker/./contrib/llvm-project/libcxx/include/thread:284:5 (clickhouse+0xfb09871) #27 void* std::__1::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'()>>(void*) build_docker/./contrib/llvm-project/libcxx/include/thread:295:5 (clickhouse+0xfb09871) Mutex M0 (0x7ffd7fcb7038) created at: #0 pthread_mutex_lock (clickhouse+0x7bee15b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (clickhouse+0x232d9c79) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::mutex::lock() build_docker/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (clickhouse+0x232d9c79) #3 std::__1::lock_guard::lock_guard[abi:v15000](std::__1::mutex&) build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (clickhouse+0xfaaf2b9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1510:25 (clickhouse+0xfaaf2b9) #5 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T288 'TCPHandler' (tid=295, running) created by thread T263 at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr>) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:198:6 (clickhouse+0x1f65b13f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 Poco::Thread::start(Poco::Runnable&) build_docker/./base/poco/Foundation/src/Thread.cpp:118:2 (clickhouse+0x1f65cc0f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #3 Poco::PooledThread::start() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:78:10 (clickhouse+0x1f660ecb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 Poco::ThreadPool::getThread() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:446:14 (clickhouse+0x1f660ecb) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string, std::__1::allocator> const&) build_docker/./base/poco/Foundation/src/ThreadPool.cpp:350:2 (clickhouse+0x1f6612c7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (clickhouse+0x1f407c4b) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 Poco::Net::TCPServer::run() build_docker/./base/poco/Net/src/TCPServer.cpp:148:21 (clickhouse+0x1f4067b7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1f65d1af) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1f65b769) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) Thread T256 'AsyncMetrics' (tid=263, running) created by main thread at: #0 pthread_create (clickhouse+0x7bec4cb) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_docker/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (clickhouse+0xfb08f3e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #2 std::__1::thread::thread::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool)::'lambda0'(), void>(void&&) build_docker/./contrib/llvm-project/libcxx/include/thread:311:16 (clickhouse+0xfb08f3e) #3 void ThreadPoolImpl::scheduleImpl(std::__1::function, Priority, std::__1::optional, bool) build_docker/./src/Common/ThreadPool.cpp:179:35 (clickhouse+0xfb01001) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #4 ThreadPoolImpl::scheduleOrThrow(std::__1::function, Priority, unsigned long, bool) build_docker/./src/Common/ThreadPool.cpp:249:5 (clickhouse+0xfb01bf6) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #5 ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::ConfigReloader::*&&)(), DB::ConfigReloader*&&) build_docker/./src/Common/ThreadPool.h:222:38 (clickhouse+0x1b8564f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #6 DB::ConfigReloader::start() build_docker/./src/Common/Config/ConfigReloader.cpp:42:18 (clickhouse+0x1b8555f9) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #7 DB::Server::main(std::__1::vector, std::__1::allocator>, std::__1::allocator, std::__1::allocator>>> const&) build_docker/./programs/server/Server.cpp:1834:31 (clickhouse+0xfab2bba) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #8 Poco::Util::Application::run() build_docker/./base/poco/Util/src/Application.cpp:315:8 (clickhouse+0x1f42019e) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #9 DB::Server::run() build_docker/./programs/server/Server.cpp:395:25 (clickhouse+0xfa9f45f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #10 Poco::Util::ServerApplication::run(int, char**) build_docker/./base/poco/Util/src/ServerApplication.cpp:131:9 (clickhouse+0x1f43f9b4) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #11 mainEntryClickHouseServer(int, char**) build_docker/./programs/server/Server.cpp:201:20 (clickhouse+0xfa9c623) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) #12 main build_docker/./programs/main.cpp:492:12 (clickhouse+0x7c75ad7) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) SUMMARY: ThreadSanitizer: data race (/usr/bin/clickhouse+0x7c7471f) (BuildId: 4d343f3f72179b0aa8724d0232c32ea1cd8e7f87) in operator delete(void*, unsigned long) ================== ThreadSanitizer: reported 17 warnings (cluster.py:3054, shutdown) 2026-10-31 00:09:34 [ 353 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/logs/stderr.log* || true'] (cluster.py:105, run_and_check) 2026-10-31 00:09:34 [ 353 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_1/backup_node/docker-compose.yml', 'down', '--volumes'] (cluster.py:105, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_main_node_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_backup_node_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo2_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo3_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo1_1 ... (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_backup_node_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo1_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo3_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_main_node_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo2_1 ... done (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stderr:Removing network roottestsystemstartstoplisten_default (cluster.py:115, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Cleanup called (cluster.py:754, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 29.9.2 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.38.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v5.6.1 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 38 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51 runc version: v1.5.2-0-g29dd3dc2 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-130-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.59GiB Name: a6986a094fcd ID: 53fefab7-1d8c-495d-a06e-efd0556b52e1 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2026-10-31 00:09:35 [ 353 ] DEBUG : Docker networks for project roottestsystemstartstoplisten are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2026-10-31 00:09:35 [ 353 ] DEBUG : Docker containers for project roottestsystemstartstoplisten are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2026-10-31 00:09:35 [ 353 ] DEBUG : Docker volumes for project roottestsystemstartstoplisten are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2026-10-31 00:09:35 [ 353 ] DEBUG : Command:docker container list --all --filter name='^/roottestsystemstartstoplisten_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : No running containers for project: roottestsystemstartstoplisten (cluster.py:782, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Images pruned (cluster.py:807, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup) 2026-10-31 00:09:35 [ 353 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check) 2026-10-31 00:09:35 [ 353 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) ============================== slowest durations =============================== 23.64s teardown test_system_start_stop_listen/test.py::test_except 21.89s call test_system_start_stop_listen/test.py::test_except 20.84s setup test_system_start_stop_listen/test.py::test_except =========================== short test summary info ============================ ERROR test_system_start_stop_listen/test.py::test_except - Exception: Sanitiz... PASSED test_system_start_stop_listen/test.py::test_except ==================== 1 passed, 1 error in 67.54s (0:01:07) ===================== Traceback (most recent call last): File "/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration/./runner", line 457, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_zd7pz2 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=2741 -e DOCKER_BASE_TAG=2741 -e DOCKER_KERBERIZED_HADOOP_TAG=2741 -e DOCKER_KERBEROS_KDC_TAG=2741 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=2741 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=2741 -e DOCKER_MYSQL_JS_CLIENT_TAG=2741 -e DOCKER_MYSQL_PHP_CLIENT_TAG=2741 -e DOCKER_NGINX_DAV_TAG=2741 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=2741 -e DOCKER_PYTHON_BOTTLE_TAG=2741 -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 test_system_start_stop_listen/test.py::test_except -vvv" altinityinfra/integration-tests-runner:2741 ' returned non-zero exit status 1.